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Outline of the talk 


Q9 Entropy of trees & tree automata. 

Q9 Entropy of tree automata = joint spectral radius. 
@ The zero-error coding problem with states. 

@ Approximating zero-error capacities of codes. 
@ Open problems, etc. 
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| 
Tree automata 


9 Tree automaton : A = (Q, ô, qo) : 


> 6C Qx29. 
» Labels - states. 
» No accepting condition. 


9 (Infinite) Q-trees : t: N* — Q with prefix-closed domain. 


9 L(A, Acc) # 0 iff A accepts a regular tree. 
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-— —— — —— "1 
Entropy of tree automata 


9 Entropy of a Q-tree : 
1 
H(t) = lim sup — log card(t| ) 
n n n 


> ta = the set of nodes on level n. 
» Trees regarded as sets of runs sharing common prefixes. 


Q9 Entropy of a tree automaton : 
H(A) = sup {H(t) | te L(A)} 


» The size of the largest set of runs generated by A. 
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(————— — I| 
The set of adjacency matrices of a tree automaton 


9 Consider Q = {1,..., n}. 
9 For each į < nand D c ó(i), put mp € (0, 13" the vector with : 


,_ fi ifjeD 
mi,p[j] = lo otherwise 


9 The set of adjacency matrices over (&(i is 


asics 


Ma = (M € Mat(n x n) | 3D with M[i, e] = mp} 
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——————— áà1 
A property of the joint spectral radius 


9 The joint spectral radius of a set of matrices M : 
P(N) = sup (IM -...- Mall | M; € NVI < n} (1) 


9 Set with independent row uncertainties (IRU) : for each i there exists R; C Ryo” s.t. : 


N TOL LL wy weh). 


Theorem (Blondel & Nesterov '09) 
If the IRU set.N is composed of nonnegative matrices, then 
P(N) = max{p(A) | Ae N}. 
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l— — V——— ———— 
Entropy of tree automata (2) 


Proposition 
For any tree automaton A, H(A) = log p(.M4) = max{p(A) | A € M(A)}. | 


@ Remark : there exist trees t for which different transitions might be used at distinct nodes 
labeled with the same state. 


@ Hence, card(t| ) might not belong to the set {|My -...- Mnl|'/" | M; € NVI < n}. 
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— — —ÁÀ——— 1 
Entropy of tree automata (3) 


9 A Q-tree is isolevel if for all xq, xo € supp(t), with [x1| = |xo| = k and t(x;) = t(x2) we have 
that Vk € N, (f(%1), (041), ..., to )) = (t0), t(x21), .. . , toe k)). 


> An isolevel tree is not a regular tree ! 


9 Proof technique : show that, for each tree t, there exists an isolevel tree t" s.t. H(t) < H(t’). 
> Suppose some f, is built upto level n (approximating t upto level n). 
> For each state q occurring in (t7) lo choose, among all trees with root q, the tree tiia] 
which contributes the most to H(t). 


> Build t? , , by using only t;[g]. 
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Generalized zero-error coding 
9 Synchronous transducer 7 = (Q,2,A,0,qgo),6 C Qx X x Ax Q. 
9 LC X" is distinguishable if Vw4, wo € L, (qo, w1)  6(qo, wa) = 0. 
> Similar definition for L C X. 
Q9 Examples : 


b/y,z 
c/z,t 


a/c b/c a/x, y 
a/c a/d d/t,u 
e/u, x 
@ The capacity of 7 is 
C(T) = lim sup {H(L) | L C X^, L distinguishable } 
n 
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C(T) = lim sup {H(L) | L C X^, L distinguishable } 
n 
@ The w-capacity of 7 is : 
C“(T) = sup {H(L) | L C X", Lis distinguishable} 
@ The w-regular capacity of 7 is : 


C? (T) = sup {H(L) | L C X”, Lis distinguishable and w-regular} 
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a 
C"? is “unnatural” 


0/a a/b a/a 


1/a 
9 Consider the non-w-regular language : 


Lo = {zat b" | z e (0-- 1)* 3, 


> Here Zo is the value of z as an integer written in base 2. 
9 L, is 7 -distinguishable : 
> VwecL3lz € N with T(w) = allege 7+1] bza”. 


@ Hence 
COT) 2 AL m1 


@ But 


H(Lout(TTT)) = H(a* bb* aa^) = 0! 
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—————Ó—S* 
Relating C(7) and C?(7) 


Proposition 
C?(T) € C(T). | 


9 Given R C X" distinguishable, any prefix R[1 ... n] can be "extended" to a distinguishable 
Ri € "+r for some Ng depending on R. 


P 


roposition 
If T is connected and has a synchronizing word then C? (T) = C(T7 ). | 


9 Given L C X" with card(L) > C(T) — e, create a regular tree from L by piling copies of L. 


Q9 The extra paths needed to connect two copies of L is bounded by the length of the 
synchronizing word + the diameter of the automaton. 


9 The hypothesis on the synchronizing word can be weakened to requesting that, for any set of 
states S C Qin the determinization of Tin, there exists a state q and a word w such that 


r“ gforanyr c S. 
> Property which trivially holds when 7;, is deterministic. 
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Tree automata from (special) channels 


9 Assume Tin = (Q, ©, din, qo) is deterministic. 
@ Construct a tree automaton Ay : 
> At each state choose distinguishable sets of outgoing transitions : 


a/x 
b/y,z 
D A 
c/z 
d/z,t 
> (q, S) € 8 if foreach 4, r2 € S,ifq aty nq oy, rofora zz band x Æ y then rj = h. 
@ Then 

P(A) € C(T) 
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Tree automata from (special) channels 


9 Assume Tin = (Q, ©, din, qo) is deterministic. 
@ Construct a tree automaton Ay : 
> At each state choose distinguishable sets of outgoing transitions : 


a/x 
O- et NZ 


@ Then 


BE) 
> (q, S) e 0ifforeach 4, r2 


S,ifq aX, q PIY, P for a band x 
P(A) € C(T) 
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Tree automata from (special) channels 
9 Assume Tin = (Q, ©, din, qo) is deterministic. 
@ Construct a tree automaton Ay : 


> At each state choose distinguishable sets of outgoing transitions : 


a/x 
e/t l © 
èz 
> (q, S) €90 if for each 4, r2 € S, if q idm nq bly, fo fora # band x 
@ Then 
P(A) € C(T) 
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Tree automata from channels (2) 


9 Assume Tin = (Q, ©, din, qo) is deterministic. 
9 For each n, construct the tree automaton A‘ : 
> At each state choose distinguishable sets of runs of length n. 


> (q, S) € 8 if for each rj, r2 c S, itg “41, and q "2/*, r for w, Zz Wo, 


Wi, W2 € X^, and x Z y then r, = h. 


Proposition 


1 
„im F logs p(.A7-) = C(T) when Ti is deterministic. 
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Open problems 


9 Does always C? (T) =C(T)? 
1 
9 Characterize transducers for which nim, " log p(.A7-) = C(T). 


9 Explore the possibility to express H(t) > H(t’) using some enrichment of MSO with special 
predicates. 


n 5 - 
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